On the asymptotic tightness of the Shannon lower bound
نویسندگان
چکیده
New results are proved on the convergence of the Shannon lower bound to the rate distortion function as the distortion decreases to zero. The key convergence result is proved using a fundamental property of informational divergence. As a corollary, it is shown that the Shannon lower bound is asymptotically tight for norm-based distortions, when the source vector has a finite differential entropy and a finite (Y th moment for some (Y > 0, with respect to the given norm. Moreover, we derive a theorem of Linkov on the asymptotic tightness of the Shannon lower bound for general difference distortion measures with more relaxed conditions on the source density. We also show that the Shannon lower bound relative to a stationary source and single-letter difference distortion is asymptotically tight under very weak assumptions on the source distribution.
منابع مشابه
A Necessary and Sufficient Condition for the Asymptotic Tightness of the Shannon Lower Bound
The Shannon lower bound is one of the few lower bounds on the rate-distortion function that holds for a large class of sources. In this paper, it is demonstrated that its gap to the rate-distortion function vanishes as the allowed distortion tends to zero for all sources that have a finite differential entropy and whose integer parts have a finite entropy. Conversely, it is demonstrated that if...
متن کاملAn Improved Sphere-Packing Bound for Finite-Length Codes on Symmetric Memoryless Channels
This paper derives an improved sphere-packing (ISP) bound for finite-length codes whose transmission takes place over symmetric memoryless channels. We first review classical results, i.e., the 1959 sphere-packing (SP59) bound of Shannon for the Gaussian channel, and the 1967 sphere-packing (SP67) bound of Shannon et al. for discrete memoryless channels. A recent improvement on the SP67 bound, ...
متن کاملProjection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures
The explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion function is achieved by a projection to the mixture family defined by the distortion measure. In t...
متن کاملStatistical Hypothesis Testing and Lower Bounds to the Error Probability
Two alternative exact characterizations of the minimum error probability of Bayesian M -ary hypothesis testing are derived. The first expression corresponds to the error probability of an induced binary hypothesis test and implies the tightness of the meta-converse bound by Polyanskiy, Poor and Verdú; the second expression is function of an information-spectrum measure and implies the tightness...
متن کاملThe Correlation between Sacroiliac Joint Dysfunction and Hip Adductor Tightness
Background. Low back pain is one of the ten most common causes of disability, and sacroiliac joint dysfunction is one of the most common causes of it. Objectives. This study aimed to find if there is any association between hip adductor tightness with sacroiliac joint dysfunction. Methods. Sixty people who had attended our Sports Medicine Clinic took part in this study (30 in each group). The...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Information Theory
دوره 40 شماره
صفحات -
تاریخ انتشار 1994